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INTRODUCTION 

The  P-3C  Orion  (a  land-based,  anti-submarine  warfare  aircraft)  UPDATE  IV  avionics  system  will 
include  high  resolution  color  displays  for  the  presentation  of  tactical  situation  information.  With  the 
advent  of  color  displays  into  a  variety  of  airborne  systems,  human  factors  engineers  must  determine  the 
optimum  way  to  color  code  symbology  to  improve  operator  efficiency. 

A  recent  study  conducted  at  the  Naval  Submarine  Medical  Research  Laboratory  (Jacobsen,  Rogers, 
and  Neri,  1986)  investigated  contact  symbology  coding  and  found  non-redundant  color  coding  superior 
to  redundant  color  coding  when  threat  was  coded  only  by  color  and  platform  was  coded  only  by  shape. 
Given  that  this  coding  scheme  is  implemented  in  UPDATE  IV,  the  question  arises  as  to  which  application 
of  color  is  best  for  improving  the  proficiency  of  operators  during  search  and  identification  tasks:  outlining 
the  shapes  with  color  or  filling  the  shapes  with  color.  Filling  shapes  with  color  produces  shapes  of 
greater  apparent  brightness  than  those  that  are  outlined  in  color.  Ease  of  target  detection  can  depend  on 
relative  brightness  (Stelmach,  1 984).  Therefore,  shapes  coded  with  filled  color  should  be  more  quickly 
detected  and  identified  than  those  coded  with  outlined  color.  The  goal  of  the  present  experiment  is  to 
investigate  the  effect  and  make  recommendations  based  on  the  findings. 


1 


NADC-89004-60 


METHODS  AND  MATERIALS 


SUBJECTS 

Twenty-four  Naval  Air  Development  Center  employees  (15  male  and  9  female)  served  in  this 
experiment.  All  subjects  had  normal  or  corrected-to- normal  vision  and  were  color-normal  (trichromats). 
Each  participated  individually  in  a  single  session  lasting  fifteen  minutes. 

VISUAL  DISPLAYS 

Two  training  displays  and  two  trial  displays  were  created.  One  training  display  familiarized  subjects 
with  the  shape  and  color  codes  employee,  the  shapes  were  those  'top-down'  symbols  (designed  to 
resemble  the  configuration  of  the  platform  when  viewed  from  above)  meaning  aircraft,  ship,  submarine, 
and  unknown.  The  colors  used  to  code  platform  affiliation  were:  red  -  hostile,  green  -  U.S.,  cyan 
(blue-green)  -  friendly,  white  -  neutral,  and  yellow  -  unknown  (figure  1 ). 

The  second  training  display  and  the  two  trial  displays  were  simplified  tactical  plots  that  were  divided 
into  quadrants.  Each  contained  symbols  that  were  randomly  assigned  combinations  of  the  'top-down' 
shapes  and  the  threat  colors.  The  conjunctively  defined  symbols  were  randomly  positioned  in  a  specific 
rotation:  0,  90,  180,  or  270  degrees.  The  symbol  density  was  an  average  five  per  quadrant  on  the 
training  display  and  fourteen  per  quadrant  on  the  trial  displays.  Both  trial  displays  were  created  in  a 
shape  color-outlined  condition  (in  which  the  colored  outline  was  a  pixel  width)  and  a  shape  color-filled 
condition  (figures  2  and  3).The  training  display  contained  both  conditions  in  order  to  acquaint  subjects 
with  each  condition  simultaneously  and  demonstrate  their  equivalent  meaning.  These  displays  were 
created  with  two  constraints:  (1 )  no  symbols  could  overlap  and  (2)  no  symbols  could  contact  a 
quadrant  border.  The  shapes  were  inscribed  within  a  box  18  pixels  (.39')  high  by  15  pixels  (.33')  wide 
on  the  subjects’display  which  yielded  visual  angles  of  44.69  arc-minutes  at  C  and  180  degrees  rotation 
and  37.82  arc-minutes  at  90  and  270  degrees  rotation  when  viewed  from  30".  These  visual  angles  were 
large  enough  to  eliminate  small-field  chromaticity  problems  but  small  enough  so  that  saccades  would 
not  be  necessary  while  viewing  individual  symbols.  The  symbols  were  set  against  a  dark  grey 
background  measuring  .559  candelas/m2.This  generated  a  filled  symbol  modulation  contrast  range  of 
.905  to  .979  in  an  area  with  very  little  ambient  illumination. 

EQUIPMENT 

Stimuli  were  created  on  an  Amiga  2000  using  Deluxe  Paint  II.  The  experimental  set-up  was  located 
in  the  Naval  Air  Development  Center  Man-Machine  Integration  Laboratory  (MMIL)  and  approximates  the 
operator-display  relationship  in  UPDATE  IV.  It  consisted  of:  An  obscured  Amiga  2000  using  a  Barco 
CM22  monitor  to  format  the  stimuli,  a  separate  control  box  to  route  the  Amiga  video  (figure  4)  via  a 
RS-170A  to  a  video  switcher  (VAX  controlled  by  an  RS-232)  then  via  another  RS-170A  to  a  cockpit 
simulator  containing  a  Mitsubishi  1 9V"  High-Resolution  Color  Display  Monitor  (640  X  480).  An 
adjustable  aircraft  seat  was  positioned  so  that  subjects  viewed  the  display  from  30'  (figure  5).  A  second 
button  on  the  control  box  at  the  Amiga  station  stops  the  video  relay  to  the  subject  display.  The  subject 
station  included  a  single  push-button  box  that  stops  a  remote  timer  (set  to  record  milliseconds)  internal 
to  a  Digital  VAX  11/785  (connected  using  a  FORTRAN  program).  The  timer  sequence  is  activated  by  a 
depression  at  the  Amiga  station  control  box.  When  the  subject  depresses  his  control  button,  the  time 
sequence  stops  and  the  time  is  displayed  on  a  second  Barco  CM22  located  at  the  Amiga  station. 
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Figure  1 .  Shape  and  Color  Codes. 
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Figure  2.  Example  Color-Outlined  Trial  Display. 
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Figure  3.  Example  Color-Filled  Trial  Display. 
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Figure  4.  Experimenter  Station:  Stimuli  Display  (left),  Timer  Output  Display  (Right), 
Video  Switching  Control  Box  (Lower  Right). 
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EXPERIMENTAL  PROCEDURE 

The  procedure  that  was  used  is  a  variation  of  the  procedure  Hovey  and  Berson  (1 987)  used  to 
evaluate  anti-submarine  warfare  tactical  symbology.  After  giving  their  written  consent,subjects  were 
positioned  in  the  aircraft  seat  and  (with  room  lights  off)  were  shown  the  display  which  lists  the  shape 
and  color  codes  (figure  1  ).They  were  then  given  a  short  test  to  confirm  their  knowledge  of  the  codes  (if 
they  failed,  they  were  provided  with  additional  study  time).  Next  they  were  shown  the  sample  tactical 
plot.  It  was  emphasized  that  the  plot  is  divided  into  quadrants  and  that  the  color-outlined  or  color-filled 
conditions  are  equivalent  in  meaning. 

The  subjects  were  then  instructed  in  the  trial  procedure:  first  they  were  given  instructions  on  the 
type  of  task  (e.g.  find  the  quadrant  with  the  most  neutral  submarines);  second,  they  were  told  that  the 
tactical  plot  will  appear  on  their  monitor  and  they  should  then  locate  the  quadrant  satisfying  the  task; 
third,  upon  acquiring  the  correct  quadrant,  they  should  immediately  depress  their  push-button  and  then 
point  to  the  quadrant  (at  this  point,  the  investigator  blanks  the  display  and  prepares  the  subjects  for  the 
next  task).  The  subjects  ran  through  four  sample  tasks  (more  if  the  subject  required  additional  practice) 
prior  to  the  actual  testing.  They  were  told  to  work  as  quickly  as  possible  without  making  an  error. 

There  were  two  different  tactical  plot  arrangements  presented  to  the  subjects  (figures  2  and  3).  Both 
plots  appeared  in  a  color-outlined  and  color-filled  version  as  well  as  requiring  a  unique  task  (i.e.  most 
hostile  ships  and  most  U.S.  aircraft).  Therefore,  counterbalancing  was  achieved  by  alternating  symbol 
arrangements,  color  condition,  and  associated  task.  This  procedure  worked  to  eliminate  any  sequence, 
task  or  practice  effects.  Subjects  were  debriefed  and  interviewed  at  the  conclusion  of  the  testing. 

RESULTS 


TASK  TIMES:  FILLED  VERSUS  OUTLINED 

Three  subjects  out  of  the  group  of  twenty-four  failed  to  identify  the  correct  quadrant  during  one  task 
and  therefore  their  task  times  had  to  be  discarded.  This  negligible  error  rate  demonstrates  that  the 
subjects  worked  carefully  and  that  there  is  no  difference  in  the  subjects’  ability  to  successfully  complete 
the  tasks  in  either  condition  (as  it  bears  on  this  experiment).  There  was  a  significant  difference  in  the 
time  subjects  needed  to  complete  a  visual  search  task  in  each  condition  (figure  6):  testing  at  a  .05  level 
of  significance  with  a  directional  t-test,  the  time  to  complete  a  task  in  the  color-filled  condition  was 
significantly  less  when  compared  with  the  time  to  complete  a  task  in  the  color-outlined  condition  (t  = 
2.121,  p  =  <.025,  xfiii  =  6.244  sec.  and  xouttine  =  7.359  sec  ). 

INTERVIEW  FINDINGS 

Most  subjects  (75%)  reported  a  marked  preference  for  the  color-filled  condition  (17%  preferred  the 
color-outlined  condition  and  8%  had  no  preference).  An  even  greater  percentage  (87%)  reported  that 
they  perceived  the  color-filled  condition  as  having  a  greater  apparent  brightness  than  the  color-outlined 
condition.  Indeed,  most  subjects  stated  that  their  preference  for  the  color-filled  condition  was  predicated 
on  the  additional  color  on  the  display  and  how  this  color  enhanced  the  color  and  shape  (definition) 
dimensions  and  improved  contrast  and  brightness. 

For  most  subjects,  learning  the  color  and  shape  codes  did  not  result  in  a  heavy  memory  load 
(especially  when  considering  the  stereotypical  nature  of  the  codes)  and  the  tasks  were  deemed  to  be 
simple  ones.  Rare  confusion  did  occur  between  the  identification  of  the  ship  versus  the  submarine 
shape  (these  subjects  tended  to  lump  sea-going  vessels  together)  and  between  the  meanings  of  white 
and  yellow.  Also,  to  some  subjects,  the  distinction  between  a  U.S.  platform  ar  ri  a  friendly  platform  was 
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Figure  6.  Difference  in  Condition  -  Related  Task  Times  Across  Subjects. 
Note  superiority  of  Filled  Condition. 
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not  clear  and  therefore  had  to  be  explained.  None  of  these  problems  appeared  to  impact  the  acquisition 
of  the  targets  during  the  tasks. 


DISCUSSION 

This  experiment  examined  the  effect  of  color  on  the  time  required  to  conduct  a  visual  search.  An 
explanation  of  this  effect  will  be  aided  by  first  understanding  the  context  in  which  it  was  produced, 
namely,  the  search  for  the  symbol  targets.  Triesman  (1 982)  developed  a  multi-stage  model  of  visual 
processing  which  distinguishes  between  two  levels:  an  automatic  level  and  a  focused  attention  level.  At 
the  first  level,  certain  features  of  the  visual  scene  (e.g,  symbol  colors)  are  processed  for  the  entire  visual 
field  simultaneously  -  attention  is  not  directed  to  any  specific  location.  At  the  second  level,  other  features 
(e.g.,  top-down  shapes)  are  purposefully  attended  to  and  processed  serially.  Egeth,  Virzi,  and  Garbart 
(1984)  refined  this  model  for  the  case  of  a  search  for  conjunctively  defined  targets.  They  conducted  an 
experiment  in  which  subjects  searched  for  conjunctive  targets  (e.g.,  red  O)  in  a  field  where  the  numbers 
of  two  distractors  were  unconfounded  (the  number  of  one  distractor  type,  e.g.,  black  Os  or  red  Ns,  was 
held  constant  while  the  number  of  the  other  distractor  type,  e.g.,  red  Ns  or  black  Os,  varied).  Egeth  et  al. 
found  that  the  search  need  noi  proceed  by  a  serial  examination  of  each  display  item.  Subjects  are  able 
to  restrict  search  to  potential  targets  that  were  the  same  color  as  the  target  (and  possibly  the  same  form 
as  well).  Within  the  set  of  potential  targets,  search  may  be  serial. 

The  validity  of  the  feature  integration  theory,  described  above,  is  in  jeopardy,  however.  Recent 
research  (Pashler,  1987)  supports  a  model  postulating  that  dense  displays  of  conjunctively  defined  items 
are  searched  by  a  "serial  self-terminating  search  over  relatively  large  clumps  of  items,  and  a  parallel 
search  within  those  clumps.”  This  suggests  that  the  nature  of  the  attentional  mechanisms  formulated  by 
Triesman  (1982)  for  handling  feature  conjunction  in  the  item-by-item  serial  processing  hypothesis  may 
not  be  correct.  More  research  is  needed  to  conclusively  validate  either  of  the  opposing  models. 

The  performance  increment  witnessed  in  the  color-filled  condition  of  the  present  experiment  might 
be  explained  by  the  greater  apparent  brightness  available.  Specifically,  the  assumption  made  is  that 
brightness  mediates  the  rates  of  target  detection  and  processing  (see  Steimach,  1984).  More  research  is 
required  to  provide  an  adequate  explanation  of  what  processes  are  at  work  here  (as  well  as  confirm  the 
results  at  a  larger  sample  size)  and  if  the  brightness  difference  can  be  attributed  to  an  achromatic  or 
chromatic  channel. 

Operationally,  the  results  of  this  experiment  suggest  that  the  use  of  color-filled  tactical  symbols 
opposed  to  color-outlined  tactical  symbols  would  be  beneficial.  Color-filled  symbols  will  provide  more 
brightness  and  discriminability  given  the  same  pixel  luminance  as  an  outlined  figure  and  will  improve 
operator  performance  during  search  and  identification  tasks.  It  is  recommended  that  ail  color  coded 
symbols  be  filled  (at  least  when  the  display  will  have  the  tested  symbol  density  or  lower)  or  that  the 
color-filled  condition  be  reserved  for  designating  high  value  units.  The  state  of  tactical  situation 
formatting  probably  makes  the  second  choice  more  viable  at  this  time. 

The  results  of  this  experiment  are  strongly  supported  by  the  recent  findings  of  Lyons,  Powers, 
Vala-Rossi,  Purcell,  and  Schieber  (1988).  Their  study  examined  the  interaction  effect  that  occurred  when 
subjects  searched  for  varying  colored  targets  (presented  as  solid  or  line  figures)  against  solid  colored 
backgrounds  or  located  at  the  intersection  (border)  of  two  different  colors.  They  found  a  significant 
advantage  in  response  time  for  solid  targets  (color-filled  shapes)  versus  line  targets  (color-outlined 
shapes)  and  go  on  to  recommend  their  use. 

Returning  to  the  present  experiment,  recall,  however,  that  an  experimental  constraint  was  that  no 
symbols  could  overlap.  Herein  lies  a  problem.  When  color-filled  shapes  come  into  contact  with  each 
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other  the  original  shapes  are  obscured  and  new  shapes  are  formed  (especially  when  the  shapes  are  the 
same  color).  Work  needs  to  be  done  to  minimize  this  problem.  Options  include:  (1)  defilling  symbols 
when  they  overlap,  (2)  not  allowing  symbols  to  overlap,  (3)  using  the  color-filled  condition  sparingly  (i.e. 
for  high  value  units)  and  (4)  using  a  transparent  shading  fill  to  produce  a  "ghost*  that  allows  the  fill  to  be 
present  but  does  not  obscure  what  is  behind  it  (this  option  is  hardware  dependent).  These  options  must 
be  evaluated  and  the  problem  satisfactorily  addressed  before  color-fill  can  be  implemented  in  the  P-3 
UPDATE  IV  or  in  any  other  tactical  display. 
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